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ABSTRACT 

Concomitant with the evolution of biological diversity must have been the evolution 
of mechanisms that facilitate evolution, due to the essentially infinite complexity of 
protein sequence space. We describe how evolvability can be an object of Darwinian 
selection, emphasizing the collective nature of the process. We quantify our the- 
ory with computer simulations of protein evolution. These simulations demonstrate 
that rapid or dramatic environmental change leads to selection for greater evolvabil- 
ity. The selective pressure for large scale genetic moves, such as DNA exchange, 
becomes increasingly strong as the environmental conditions become more uncer- 
tain. Our results demonstrate that evolvability is a selectable trait and allow for the 
explanation of a large body of experimental results. 
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Darwin was obsessed with variation. His books, considered as an ensemble, de- 
vote much more attention to variation than to natural selection, for he knew that no 
satisfactory theory of evolutionary change could be constructed until the causes of 
variation and the empirical rule of its form and amount had been elucidated [1]. 

Whether or not the propensity to evolve, or evolvability [2-4], can be an object of Darwinian 
natural selection is a topic of great interest. Causality would suggest not due to the apparently an- 
ticipatory nature of evolvability [5,6]. Many within the field of evolutionary biology are uncom- 
fortable with the concept that evolvability is a selectable trait. A growing body of experimental 
data, however, would be explained if evolvability were a selectable trait [7-15]. 

Organisms cannot evolve, or adapt, by germ line mutation to an environmental change within 
their own lifetime. Does this mean that lineages and individuals cannot be under selection for 
evolvability? While viability is the selection criterion, the genotype that determines the viability 
arises in a mutated, evolved way from that of the previous generation as a result of base substi- 
tution, recombination, transposition, and horizontal gene transfer. These mutational processes 
are the driving forces of evolution, and their rates fundamentally determine evolvability. The 
perspective we here offer is that the evolvability of an organism is defined by the rates of ge- 
netic change, that genetic change is not always deleterious, and that these rates of genetic change 
are not fixed and are under selective pressure. That is, the mechanisms that define the rates of 
change are encoded in the genotype, and so they are selectable. An analogy with thermodynam- 
ics illuminates the issue: How is free energy minimized in a physical system of particles, despite 
the difficulty in defining the entropy of a given configuration of the particles? An ensemble of 
particle configurations allows the definition of free energy and the approach to thermodynamic 
equilibrium, just as a population of evolving organisms allows the definition of and selection for 
evolvability. 

Within the framework of point mutation, base substitution, and recombination, correlations 
of adaptation with function have been observed. It is known that immunoglobins have evolved 
so that the mutation rates in complementary determining regions, where mutation is most likely 
to generate useful variants, are much higher than those in framework regions [14, 16]. Recent 
data point to a role for DNA polymerases in regulating the somatic hypermutation rate of im- 
munoglobin genes [13, 17]. Similarly, codon usage within the influenza hemagglutinin protein 
appears to be biased to favor more rapid antigenic drift [14]. Furthermore, in HIV-1 protease the 
probability of mutation is not randomly distributed within the structure, but rather concentrated 
at sites that alter the geometry of the protein binding domain, conferring significant propensity 
for antigenic drift [18]. Such behavior is not mere curiosity and has widespread implications for 
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drug design and the evolution of drug resistance [19]. Stressful conditions may generally pro- 
voke activation of error-prone polymerases, triggering a large increase in adaptive rates [20]. Not 
only point mutation, but also recombination is widely appreciated to confer increased evolvabil- 
ity [9,21,22]. Recombination among the hemagglutinin and neuraminidase proteins, for exam- 
ple, is believed to be a significant mechanism leading to the emergence of new virulent strains 
of influenza [23]. Computational and theoretical studies have also shown the persistence under 
selection of evolvability-enhancing moves in the context of point mutation and recombination 
evolutionary dynamics [24-29]. 

The selective forces that lead to the evolution and maintenance of mechanisms for rearrange- 
ment, deletion, transfer, and transposition of genetic material, in as much as they lead to even 
greater evolution than point mutation and recombination alone, are of great interest. For exam- 
ple, the development of antibiotic resistance in bacteria has evolved mainly through the swapping 
of DNA pieces between the evolving bacteria [8, 30]. Similarly, the evolution of Eschericia coli 
from Salmonella is thought to have occurred exclusively from DNA swapping [31]. It has been 
proposed that the success of bacteria as a group stems from a capacity to acquire genes from 
a large and diverse range of species [32]. It would appear, then, that large genetic moves are 
pervasive and crucial to evolutionary dynamics [6, 8, 10-12, 15, 30, 31, 33-39]. Concomitantly, 
evolvability is enhanced by these larger moves, as shown experimentally for the case of DNA 
shuffling [32,40-44]. A key question is whether selection for evolvability fosters the husbandry 
of these moves. 

We here address, from a theoretical point of view, selection of evolvability in the presence of 
large-scale genetic moves. Although the use of the term evolvability has only recently come to 
vogue in the scientific community, investigations into the evolution of adaptation go back several 
decades [45-47]. Prominent from a theoretical perspective are works in population genetics 
[48,49] and game theory [50-52]. Despite the insights that these studies give as to the origin and 
maintenance of evolvability, evolution of and selection for evolvability remains a hotly contested 
issue, primarily due to the causality principle [5, 6]. We here show that evolvability is selected 
for, notwithstanding the constraints imposed by causality, when a system is subject to a constant, 
random environmental change. This selection of evolvability occurs even when viability as a 
function of genotype is an extremely complex function, with exponentially many optima, and 
when the evolving system is unable to reach the global optimum of viability in any one instance 
of the environment. We demonstrate our results using computer simulations of protein molecular 
evolution that incorporate selection in a varying environment. The genotype of a protein molecule 
is mapped to a complex phenotype using a random energy based model, in which all assumptions 
and relevant parameters are known. The selective pressure for evolvability is shown to be greater 
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for larger rates of environmental change. Interestingly, a generalized susceptibility of the system 
correlates with the fluctuations in the environment, albeit not as a result of generalized linear 
response theory [53]. The addition of selection for evolvability as a phenomenological law to the 
toolbox of evolutionary theory allows for the explanation of a large body of experimental results. 

The Generalized Block NK Model. Whether evolvability is selectable has been a rather 
difficult question to answer, primarily because observations in evolutionary biology tend to be 
correlative in nature and difficult upon which to make mechanistic conclusions. Therefore, we 
here consider the dynamics of evolvability in a well-defined theoretical model of protein evolution 
[54]. Within this model of protein structure and function, we have a fixed population of proteins, 
which we take to be 1000. We have a microscopic selection criterion, which we take to be the 
folding and binding of a protein to a substrate. And we have a means of inducing constant, 
random environmental change. 

We model the molecular evolution of protein systems using a generalization of the NK 
[55-57] and block NK [58] models that has been used previously to study protein molecular 
evolution strategies [54] and the immune system response to vaccination and disease [59]. The 
model includes a population of sequences, upon which selection acts, and in which occur genetic 
mutations. The mutational hierarchy includes both point mutations and large-scale swapping 
moves, akin to transposition or translocation events. While the model does not include recombi- 
nation, such inclusion is not expected to change the results, as swapping can be viewed as a pow- 
erful form of recombination [54] . For example, linkage effects are mitigated even more rapidly 
by swapping in our model than they would be by recombination. The selection for greater swap- 
ping rates in more rapidly changing environments observed in our model parallels results found 
in studies of the evolution of sex, where adaptation and variation in a heterogeneous environment 
is well-researched [60]. 

In the generalized block NK model, each individual evolving protein sequence has an energy 
that is determined by secondary structural subdomain energies, U sd , subdomain-subdomain inter- 
action energies, (J sd ^ sd , and chemical binding energies, U c . This energy is used as the selection 
criteria in our studies and is given by 

MM P 

u = T, u $+ E ut sd + T,u-- (i) 

i=l i>j=l i=l 

Within our generalized block NK model, each protein molecule is composed of M = 10 sec- 
ondary structural subdomains of N = 10 amino acids in length. We consider five chemically 
distinct amino acid classes (negative, positive, polar, hydrophobic and other) and L = 5 different 
types of subdomains (helices, strands, loops, turns and others). We therefore have L different 
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subdomain energy functions of the NK form 

Y N-K+l 

U S = ^(AT-iT)] 1 / 2 § ° ai ^ " ' ' aj+K -^ ' (2) 

where aj is the amino acid type of the jth amino acid in the subdomain, and a { is the type of the 
ith subdomain. As in previous studies, we consider the case where the range of the interactions 
within a subdomain is specified by K = 4 [54,59]. Here a ai is a quenched Gaussian random 
number with zero mean and a variance of unity, and it is different for each value of its argument 
for each of the L subdomain types, cej. The interaction energy between secondary subdomain 
structures is given by 

1/2 



«7 



sd— sd 



DM(M — 1) 

D 

X * 

k=l 



2^ a ij v ji ' " ' ' ii ' 'jk /2+i ' • • • u 3kJ ' 



where we consider D = 6 interactions between secondary structures [54,59]. The zero-mean, 

(k) 

unit- variance Gaussian a\j and the interacting amino acids, ji, . . . , Jk, are selected at random 
for each interaction k). In our model, P = 5 amino acids contribute directly to a binding 
event, as in a typical pharmacophore, where the chemical binding energy of each amino acid is 
given by 

Uf = -^=a t (a,) , (4) 

where the zero-mean, unit-variance Gaussian cr, and the contributing amino acid, i, are chosen at 
random. 

System Evolution and Environmental Change. Our model system maintains a constant 
population of 1000 proteins, each protein of 100 amino acids in length and initially distinct in 
sequence. The system evolves through the base substitution of single amino acids and via DNA 
swapping of amino acid subdomains from structural pools representing the five different subdo- 
main types, each containing 250 low-energy subdomain sequences. These moves represent the 
small-scale adaptation and the large-scale, dramatic evolution that occur in Nature. For protein 
i, n mut (i) point mutations occur per sequence per round of selection. In addition, for protein 
i, subdomain sequences are randomly replaced with sequences from the same-type low-energy 
pools with probability p swa , p (i). 

Following pool swapping and point mutations, selection occurs, and the 20% lowest-energy 
protein sequences are kept and amplified to form the population of 1000 proteins for the next 
round of selection. The parameters p swa , p (i) and n nmt (i) are allowed to take a log-Gaussian ran- 
dom walk for each protein sequence. This process is repeated for iVg Cn rounds of selection, after 
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which an environmental change is imposed on the system with a severity that is characterized 
by the parameter, p [59]. The parameter p is the probability of (i) changing the type of each 
of the 10 subdomains in the protein sequences, in Eq. |2j (ii) changing the amino acids and 
energies that are involved in subdomain-subdomain interactions, jk and in Eq. and (iii) 
changing the amino acids and energies that are involved in the chemical binding, i and <7j in Eq. 
HI We repeat the process for a total of 100 environmental changes and average our results over 
1000 instances of the ensemble. For each system studied, a steady-state in n mut , p S wa P , and the 
average energies at the beginning, (£/) st art, and end, (U) cn a, of the dynamics in a single instance 
of the environment is reached after fewer than 80 environmental changes in all cases. We average 
the data over the last 20 environmental changes. We study how the frequency of environmental 
change, 1/N gcn , and the severity of environmental change, p, affect the evolvability of the protein 
sequences. A schematic diagram showing the molecular evolution of our protein system can be 
seen in Fig. 1. 

Selection For Evolvability. Shown in Fig. 2 are the steady state values of p swap and n mut that 
our protein system selects as a function of imposed frequency of environmental change, 1 /iV gen , 
and severity of environmental change, p. The DNA swapping moves that we propose have a 
high capacity for evolutionary change, as a significant number of amino acids may be altered in 
a protein sequence in one swap move. It is clear that our systems select for higher probabilities 
of DNA swapping moves, and thus evolvability, as the frequency and severity of environmental 
change increases. We stress the importance of this result. Mainstream evolutionary theory does 
not recognize a need for the selection of evolvability. More generally, we see that only in the limit 
of little or no environmental change, p swap — ► 0, do large scale changes tend to be disfavored. The 
role of base substitution in our evolving system is more complex. For more severe environmental 
changes and for higher frequencies of environmental change, the system depends more on DNA 
swapping than on point mutation to produce low-energy proteins. In these cases, since the protein 
must make large changes to its sequence to adapt to the environmental change, selection results 
in high values of p swa p, with base substitution having only a small effect on the energy of the 
protein. For less severe environmental changes and lower frequencies of environmental change, 
base substitution is sufficient to achieve the small modifications in protein sequence that are 
required for adaptation to the environmental change. Thus, we observe the higher dependence 
on n mut and lower dependence on p SW a,p for small p. In addition, as l/iVg en — > 0, n mut — > since 
mutations tend to be deleterious in stable systems with no environmental fluctuations. 

Evolvability is intimately related to the diversity of a population. At short times, evolvability 
can be quantified by the diffusion coefficient in protein sequence space, D , which is given by 
the combined diffusion due to swapping of the subdomains and the point mutation of individual 
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amino acids [61]: 

D = (const) (10 2 x 10p swap + l 2 n mut ) . (5) 

The overwhelming contribution to D comes from the swapping step, as the swapping move 
far more dramatically changes the sequence. The short-time diffusion rate selected for reflects, 
as a function of environmental change, a balance between staying within a favorable basin of 
attraction, or niche, and adaptation to a newly-created, superior niche. As Fig. 2 shows, greater 
environmental change favors greater local diffusion, as indicated by the monotonic increase of 

p swap With p. 

It is useful to regard base substitution as a means of fine tuning the protein sequences, whereas 
DNA swapping can be considered a source of more substantial evolutionary change. This hierar- 
chy within the space of evolutionary moves becomes more apparent when studying the difference 
between starting and ending protein sequences within one environment, as a function of p, p swap , 
and n mut . The distance between protein sequences is characterized by the Hamming distance 
between the respective amino acid sequences. For a given p, the Hamming distance decreases 
only slightly as the frequency of environmental change, 1/N gen , increases, but has a very strong 
dependence on the severity of the environmental change, p, as shown in Fig. 3a. The sensitivity 
of the Hamming distance also shows markedly different behavior to p S wa P and n mut , as shown 
in Fig. 3b. For state points with fixed n mut , 1/N gcn , and p, the Hamming distance is strongly 
dependent on the value of p swap . However, for state points with fixed p swap , 1/N gcn , and p, the 
Hamming distance displays little or no variation with n mut . The Hamming distance is a long-time 
measure of the evolvability of the system. The long-time diffusion coefficient can be defined as 
the square of the Hamming distance multiplied by the frequency of environmental change. As 
Fig. 3a implies, the long-time evolvability, as measured by the long-time diffusion coefficient, 
increases with both the severity and frequency of environmental change. 

Due to the roughness of viability as a function of sequence, the exploration performed by any 
particular individual is limited to a local basin of attraction defined by the short-time mutation 
rates, and so more independent traces through sequence space allows for more thorough evolu- 
tion. In other words, the more diverse the starting population of individuals, the greater potential 
there is for evolution. Figure 3c shows the average variance of the energy values at the end of the 
dynamics within a single instance of the environment as a function of the severity and frequency 
of environmental change. It is clear that the diversity increases monotonically with p and 1 /N gcn . 

As we have seen, evolvability is quantifiable at any point in time via measurement of diversity 
and the local mutation rates. For this reason, causality does not prevent selection for evolvability. 
Because evolvability is an observable property, it can be selected for. 

Susceptibility. A further measure of long-time evolvability is the response, or susceptibility, 
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of the system to environmental change. In Fig. 4a we plot the average energy at the start, (U) staIt , 
and end, (U) cn( \, of the dynamics within a single instance of the environment. This quantity is 
shown as a function of the severity, p, and frequency, 1/N gen , of environmental change. It is 
apparent that at low frequencies of environmental change, populations with greater diversity and 
variation, which are more evolvable, have slightly lower values of (U) cn(1 - There is also a clear 
increasing trend in (U) staxt as a function of p, which is a feature of the random energy model. 
Considering the ending energy of a protein molecule within one instance of the environment to 
be roughly the sum of n Gaussian terms from the generalized NK model 

1 n 

[/ end = — V Xi . (6) 

'n 



The starting energy of this protein molecule after an environmental change is given by 

1 n 

U 8talt = —f= x i > ( ? ) 

V n i=i 

where 

, J Xi with probability (1 — p) 
I x'l with probability p 

and where x[ are random Gaussian variables with zero mean {(x'l) = 0) whereas Xj are evolved 
variables that are better than random, and typically negative. Thus, the average starting energy of 
this protein molecule is 

1 n 

U start = —= Y,(P x 'l + (! - P) x i) ■ (9) 
So, averaging over the values in the new environment 

1 n 

U 8taTt = —= VYl - p)Xi = (1 - p)U end , (10) 
or, averaging over many environmental changes 

(tf)end " (^)start = p(U) end . (11) 

This average reduction in the energy is a measure of the susceptibility of a system, (AU) /N gen - 
({U) en d — (U) sta ,rt) /N gen . In Fig. 4b we plot the susceptibility of our system as a function of the 
severity of environmental change, p. For a fixed frequency of environmental change, the suscep- 
tibility is a linear function of the severity of environmental change, as in Eq. (fTTT) . This simple 
analysis captures the essence of the dynamics that occurs in the correlated, generalized NK 
model. Fig. 4c shows that the probability distribution of the susceptibility is Gaussian in shape. 
Note also that the variance of the susceptibility increases with p in Fig. 4c, and so the linearity 
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of the susceptibility in Fig. 4b is not simply the result of a generalized fluctuation-dissipation 
theorem. 

Implications for Evolution. Our results have wide-ranging implications for evolutionary 
theory. In our model system, populations of protein molecules that are subject to greater envi- 
ronmental change select for higher rates of evolvability. The selection criteria that we use is not 
a measure of evolvability in any way, yet the system selects for evolvability based on the implicit 
energetic benefits of adaptation to environmental change. In addition, there is no reason to as- 
sume that selection is optimal. In fact, systems optimal for one environment tend to have too 
little evolvability and tend to be selected against when faced with the inevitability of change. 

Given our results, we propose that it is not mere chance that highly evolvable species tend to 
be found in rapidly changing environments or that an environmental crisis can trigger an increase 
in the rate of the evolution of a species. Indeed, selection for evolvability allows for the explana- 
tion of many data: the existence of somatic hypermutation in the immune system [13, 14, 16, 17], 
the evolution of drug resistance in species of bacteria [8, 30], and the occurrence and success 
of transpositional events in bacterial evolution [10,31,36]. A recently studied example from 
mammals is the San Nicolas Island fox, which is a highly endangered species and the most 
monomorphic sexually reproducing animal known. This species, however, is found to have high 
levels of genetic variation within the major histocompatibility complex loci [62] that allows for 
increased pathogen resistance. 

We believe that our results are of great relevance to the field of vaccine and drug design. Cur- 
rently, the design of new vaccines and drugs is largely based on the assumption that pathogens 
evolve by local space searching in response to therapeutic and immune selection. However, it 
is clear that we must anticipate the evolutionary potential of large DNA swapping events in the 
development of viruses, parasites, bacteria, and cancers if we are to engineer effective methods 
of treating them. How evolvability correlates with treatment strategy, and how to drive pathogens 
into regions of low evolvability, where they are most easily eradicated, is of significant impor- 
tance to efforts for vaccine and drug engineering. 

Specific pathogenic examples of evolvability include the emergence of new influenza strains 
by a novel hemagglutinin neuraminidase recombination, followed by antigenic drift to a highly 
infectious strain [23], emergence of many new HIV strains with the spread of the disease from its 
site of origin in Africa [63,64], and the increased emergence of new infectious diseases associated 
with modern, post- World War II travel [65]. Further, a recent study of the dynamics of HIV-1 
recombination suggests that HIV-1 may have evolved high recombination rates in order to foster 
rapid diversification and further its survival [66]. 

Note that evolvability is not simply the observation that new strains occur, rather it is the 
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underlying probability with which new strains are created by genetic modification. These new 
strains may proliferate, and be observed. Or these new strains may fail, and not be observed 
to an appreciable extent. Fundamental study of evolvability, then, requires an appreciation of 
these underlying rates of genetic change. These underlying rates, such as polymerase error rates, 
recombination rates, and transposition rates, are what selection for increased evolvability may 
modulate [67]. These underlying rates of change are inheritable and can be altered by mutation. 
Study of these rates of genetic change, deconvoluted from observed rates of evolution which are 
these rates multiplied by a probability of survival, is of fundamental interest. 

Intriguingly, we find that at low frequencies of environmental change, populations that are 
subject to more severe environmental changes can produce lower-energy individuals than pop- 
ulations that are not subject to environmental changes, Fig. 4a. Thus, under some conditions, 
adaptability can provide global benefits. This finding can be contrasted to the simpler expec- 
tation often found in evolutionary literature that specialists are better than generalists [68]. In 
experimental studies of Chlamydomonas, generalists that were evolved in alternating light and 
dark conditions were found to be better than their ancestors in both light and dark conditions, 
but less good than specialists that had evolved exclusively in one of the environmental condi- 
tions [69]. Studies of the evolution of Escherichia coli in constant and alternating temperatures 
produced similar results [70,71]. The nature of the environmental change in these studies is not 
completely random, as in our model. In addition, the number of rounds of selected evolution 
under each environmental condition is perhaps better defined within our model. These experi- 
ments do point to possible tests of our theory. For a species that is capable of DNA swapping 
evolutionary moves, a systematic study of competency as a function of the frequency of a ran- 
dom environmental change would be of interest. We predict that under some conditions, certain 
frequencies of environmental change will produce better individuals, after a given number of 
rounds of evolution and selection, than would be produced by evolution in a constant environ- 
ment. Different severities of environmental change could also be imposed by altering the change 
in environmental variables such as temperature, food concentrations, light conditions, and ex- 
posure to disease, between samples. With regards to susceptibility, we would expect the rate of 
change of viability within an environment to be higher in systems with more frequent and harsher 
environmental changes due to greater evolvability. 

Summary. Not only has life evolved, but life has evolved to evolve. That is, correlations 
within protein structure have evolved, and mechanisms to manipulate these correlations have 
evolved in tandem. The rates at which the various events within the hierarchy of evolutionary 
moves occur are not random or arbitrary, but are selected by Darwinian evolution. Sensibly, 
rapid or extreme environmental change leads to selection for greater evolvability. This selection 
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is not forbidden by causality and is strongest on the largest scale moves within the mutational 
hierarchy. 

Many observations within evolutionary biology, heretofore considered evolutionary happen- 
stance or accidents, are explained by selection for evolvability. For example, the vertebrate im- 
mune system shows that the variable environment of antigens has provided selective pressure for 
the use of adaptable codons and low-fidelity polymerases during somatic hypermutation. This 
selective pressure for adaptable codons has further resulted in the altered codon usage of the 
immune system genes. A similar driving force for biased codon usage as a result of produc- 
tively high mutation rates is observed in the hemagglutinin protein of influenza A. Selection for 
evolvability explains the prevalence of transposons among bacteria and recombination among 
higher organisms. We suggest that therapeutics also confer selective pressure on the evolvability 
of pathogens, and this driving force to antigenic drift should be considered in drug and vaccine 
design efforts. 

This research is supported by the National Institutes of Health. The authors thank Kevin R. 
Foster for a careful reading of the manuscript. 
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Figure 1: Schematic diagram showing the evolution of the protein system. 

Figure 2: n mut (dashed line) and p swap (solid line) as a function of the frequency of environmental 
change, 1/N gen , for different values of the severity of environmental change, p. The statistical 
errors in the results are smaller than the symbols on the figure. 

Figure 3: a) Hamming distance as a function of the severity of environmental change, p, for the 
state points in Fig. |2| b) Hamming distance as a function of n mut (dashed line) and p SW a P (solid 
line) for fixed iV gon = 15 and for different severities of environmental change, p. In displaying 
the Hamming distance dependence on n mut (p swap ), we fix p swap (n mut ) to the selected values 
from Fig. |2| The selected values of n mut and p swap at each state point are shown by light and dark 
circles respectively, c) Average variance, afr , of the energy of a population at the end of an 
evolution, U en ^, as a function of the severity of environmental change, p, for different frequencies 
of environmental change, N gen . 

Figure 4: a) Average energy immediately after, (U) Btaxt , an d immediately before, (U) cn d, an envi- 
ronmental change as a function of the severity of environmental change, p, for different frequen- 
cies of environmental change, b) Average change in energy, (AC/), multiplied by the frequency 
of environmental change, l/iV gen , as a function of the severity of environmental change, p. c) 
Probability distribution of the susceptibility for different values of the severity of environmental 
change, p, for a fixed frequency of environmental change, 1/N geri = 0.1. 
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Figure [T] Earl and Deem, "Evolvability is a selectable trait" 
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